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Test  and  Evaluation  Reliance 

In  response  to  a  1989  Defense  Management  Review  Decision  (DMRD),  the  Services 
proposed,  and  OSD  approved,  the  creation  of  T&E  Reliance.  Reliance  represents  a 
corporate  and  cooperative  management  approach  to  T&E.  It  vests  more  responsibility  in 
OSD  for  corporate  T&E  planning,  and  promotes  coordinated,  centralized  investment 
planning  without  inhibiting  the  decentralized  execution  of  testing.  Reliance  helps  to  reduce 
unwarranted  duplication  and  provides  information  to  guide  decisions  on  investments, 
reductions,  and  closures. 

Reliance  began  with  corporate  studies  that  started  at  the  field  level  and  examined  existing 
test  capabilities  and  management  alternatives.  The  results  of  the  Reliance  studies  provide 
the  basis  for  future  test  investments  and  define  the  test  capability  needed  into  the  next 
century.  These  studies  resulted  in  recommendations  regarding  DoD  management 
approaches  by  area  of  test  capability. 

Under  Reliance,  a  single  manager  or  Lead  is  generally  assigned  responsibility  for  planning 
for  DoD  test  capability  in  a  specific  area.  The  Lead  is  responsible  for  fostering  cross-service 
management  arrangements,  identifying  unwarranted  duplication,  and  making 
recommendations  to  improve  test  facility  management.  The  Lead  serves  as  the  DoD  point  of 
contact  for  the  investment  area  and  is  responsible  for  coordinating  all  Service  resource 
requirements  within  the  investment  area.  The  Leads  and  the  classes  of  test  facilities  for 
which  they  are  responsible  are  listed  in  Table  1. 

The  Reliance  orocess  has  led  to  such  consolidations  as  the  transfer  of  functions  at  the 
Navy's  Trenton,  New  Jersey,  facility  to  the  Air  Forces  Arnold  Engineering  Development 
Center  in  Tenessee;  the  closure  of  the  TRESTLE  test  facility  in  New  Mexico;  and  an 
improved  Central  T&E  Investment  Program. 

Reliance  areas  and  current  Reliance  lead  services  are  as  shown  in  Table  1 . 


Table  1.  Reliance  Lead  Services  and  Agencies 
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Reliance  Area 

Reliance  Lead 

Land  Vehicles  Testing 

Army 

Chemical  Weapons/Chemical  Biological  Defense  Testing 

Army 

Gun  Munitions  Testing 

Army 

Targets 

Joint  Target  Oversight  Council 

Full-scale  fixed  wing 

Air  Force 

Sub-scale  fixed  wing 

Navy 

Rotary  wing 

Army 

Towed 

Navy 

Missile 

Navy 

Non-cooperative  scoring 

Navy 

Mobile  ground  targets 

Army 

Target  command  and  control 

Air  Force 

RF  emitters 

Navy 

Sea  targets 

Navy 

Su"face-to-Air  Weapons  Testing 

Army 

Air-to-Air  Missiles  Testing 

Navy 

Air-to-Surface  Weapons  Testing 

Air  Force 

Nuclear  Weapons  Effects  Testing 

Defense  Nuclear  Agency  (DNA) 

Electric  Gun  Testing 

Army 

Air  Breathing  Engine  Test 

Large  and  Medium  Engines 

Air  Force 

Small  Engines 

Navy 

T&E  Support  Aircraft 

Air  Force 

Fixed-Wing  Aircraft  Testing 

Fixed-Wing  Cooperative  Committee 

Electronic  Warfare  Testing 

(including  RCS  facilities  and  anechoic  chambers) 

EW  T&E  Resource  Office 

Digital  model  and  computer  simulation 

Air  Force 

Hardware-in-the-Loop 

Navy 

Installed  systems 

Navy 

Open  air  ranges 

Air  Force 

Initial  Lead  for  RCS  Measurement 

Navy 

Sub-lead  for  land  vehicles 

Army 

Sub-lead  for  sea  vehicles 

Navy 

Sub-lead  for  air  vehicles 

Air  Force 

Climatic  Test  Facilities 

Air  Force 

Supersonic  Sled  Tracks 

Air  Force 

Global  Positioning  System 

Air  Force 

Time-Space  Position 

Information  (GPS  TSPI) 

Common  Airborne  Instrumentation  System 

Navy 
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Test  Investment  Process 

The  current  Test  Investment  Review  process  focuses  on  investments  with  costs  of  $1 
million  or  more  in  a  single  year  or  $5  million  over  the  total  project.  Two  categories  of 
investments  are  covered  by  the  process:  Service-unique  and  Joint  Service  investments.  The 
Services  fund  the  former,  while  the  latter  may  be  cooperatively  funded  by  more  than  one 
Service  or  through  the  Central  Test  and  Evaluation  Investment  Program  (CTEIP).  The 
review  process  for  Service-recommended  investments  consists  of  the  steps  illustrated  by 
Figure  1 .  CTEIP-funded  projects  are  approved  by  a  separate  review  process  and  are  not 
addressed  in  Figure  1 . 

The  Joint  Program  Office  for  Test  and  Evaluation  (JPO(T&E))  initiates  the  process  with  a 
Needs  call  to  Service  Headquarters.  This  call  is  for  test  and  evaluation  investment  Needs  to 
address  known  test  capability  shortfalls  within  the  Service  framework.  The  Services  then 
r  romulgate  the  call  using  their  individual  processes,  and  Need  statements  are  generated. 
Each  Service  then  collects,  validates,  and  i  .tegrates  their  test  resource  Needs  and  submits 
them  to  the  JPO(T&E). 


Figure  1.  The  Test  Investment  Process 
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Upon  receipt  of  each  Service's  list  of  Needs,  the  JPO  groups  them  into  Reliance  areas  and 
parcels  them  out  to  the  appropriate  Reliance  Leads.  Under  the  management  of  the  Leads, 
Reliance  Panels  evaluate  the  Needs  and  recommend  endorsement/non-endorsement.  The 
Panels  also  seek  opportunities  to  combine  Needs  and  resolve  conflicts.  The  lists  are  then 
returned  to  the  JPO,  which  performs  the  administrative  function  of  collecting  the  lists  and 
distributing  them  to  the  Test  and  Evaluation  Reliance  Investment  Board  (TERIB). 
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The  TERIB's  primary  functions  in  the  process  are  to  deconflict  across  Reliance  areas  and  to 
separate  those  projects  that  may  qualify  for  joint  funding  from  those  that  meet  only  single 
Service  needs.  The  joint  Needs  are  prioritized  and  forwarded  to  the  BoOD. 

After  review,  the  BoOD  forwards  all  Needs  to  the  BoD  and  the  Defense  Test  and  Training 
Steering  Group  (DTTSG).  The  Test  and  Evaluation  Resource  Committee  (TERC)  integrates 
the  Service  joint  Needs  for  which  CTEIP  funding  is  sought  with  Defense  Agency  Needs, 
and  forwards  the  integrated  CTEIP  Needs  to  the  DTTSG.  Constraints  for  Solutions  are 
developed  by  the  DTTSG  and  the  BoD.  Initial  inputs  to  the  Defense  Planning  Guidance  are 
provided  to  the  DTTSG. 

Through  the  DTTSG,  OSD  (DTSE&E)  reviews  both  CTEIP  and  Service  Needs.  It  then 
issues  any  constraints  or  guidance  to  be  used  in  the  development  of  Solutions  to  satisfy 
those  Needs  endorsed  by  the  BoD  (for  Service)  and  the  TERC  (for  CTEIP). 

Once  the  OSD  endorses  the  Needs  lists  and  issues  constraints  and  guidance,  the  JPO(T&E) 
issues  a  Solutions  call  for  Service  Solutions,  and  the  TERC  issues  a  call  for  CTEIP 
Solutions.  The  Services  then  respond  in  a  process  very  simile  to  that  used  for  the  Needs 
Call.  The  Solutions  are  collected,  grouped,  and  distributed  to  cognizant  Leads.  The  Reliance 
panel  reviews  the  Solutions  for  endorsement/non-endorsement,  an  after  they  are 
deconflicted  and  integrated,  they  are  submitted  to  the  TERIB  and  then  to  the  BoOD  and  the 
BoD. 

The  Test  Investment  Planning  and  Review  process  hinges  upon  the  production  of  a  Test 
Capability  Master  Plan  (TCMP)  for  each  Reliance  area.  This  document  is  intended  to  define 
T&E  efforts  within  a  Lead  area.  It  describes  the  scope  of  the  Reliance  area,  test 
methodology,  existing  capabilities,  and  projected  test  capability  requirements  (investments). 
It  also  provides  the  overall  direction  and  architecture  for  the  Lead  area.  The  TCMP  is  the 
vehicle  by  which  Reliance  evaluates  new  Needs  and  Solutions  for  their  congruency  with 
planned  efforts  and  the  investment  strategy.  Each  Lead  uses  the  results  of  the  Needs  and 
Solutions  call  to  update  the  previous  year's  TCMP  to  reflect  new  initiatives,  strategies,  and 
areas  of  emphasis.  Each  area  TCMP  is  forwarded  to  the  TERIB. 

The  TERIB  uses  the  individual  TCMPs  and  endorsed  Solutions  to  develop  two  documents: 
the  Test  Resource  Master  Plan  (TRMP)  and  the  Test  Investment  Strategy  (TIS).  These 
documents  are  intended  to  serve  as  blueprints  to  define  and  guide  the  Service- wide  test 
investments.  The  TIS  provides  a  concise  statement  of  the  long-term  objectives  to  be  gained 
by  these  investments.  The  TRMP  serves  a ,  the  road  map  to  attr.i..  the  TiS's  vision  and 
includes  an  integrated  and  prioritized  compendium  of  individual  projects  intended  to 
execute  the  plan.  The  actual  process  by  which  Reliance  develops  the  TRMP  and  the  TIS 
includes  various  feedback  mechanisms  whereby  the  TERIB  can  confer  with  Reliance  Leads 
to  negotiate  acceptable  compromises.  If  participants  at  the  working  level  cannot  reach 
agreement,  the  process  allows  unresolved  issues  to  be  carried  forward  to  higher  authority 
(BoOD,  BoD,  or  ultimately  DTSE&E).  Upon  completion  of  the  TRMP  and  the  TIS,  the 
TERIB  sends  the  documents  to  the  BoOD  and  then  the  BoD.  Through  DTSE&E,  OSD 
approves  the  final  TRMP.  Through  DTSE&E,  OSD  approves  the  final  TRMP.  This  ensures 
that,  in  addition  to  serving  to  communicate  a  common  investment  strategy  to  the  T&E 
community,  the  TRMP  and  TIS  are  used  by  OSD  in  its  development  of  the  Defense 
Planning  Guidance.  Thus,  OSD  and  the  Services  will  consider  T&E  investment  priorities  in 
their  individual  Program  Objective  Memorandums  (POMs). 


